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SOME THOUGHTS ABOUT EVALUATION* 


Jane Magnan 


Now is the season of course evaluation and a time when 


Volume 4 students, faculty and Learning Development staff wonder 
about the meaning and usefulness of the mounds of com- — 
Number 3 puter cards and statistical tables. 


With the help of an article by Bergquist and Philips I 
have put the following together: 


INSTRUCTIONAL EVALUATION - The tole of evaluation in 
bringing about change in an organization is widely re- Ff = 
cognized and accepted. Any organization that wishes tof ~ 
change in a systematic and thoughtful manner must con- 
tinually assess the discrepancy between current opera- 
tions and desired outcomes. Such an assessment proce- 
dure is necessarily evaluative in nature, since values 
Local 397 4 and preferences are inherent in any statement of des- 
ired outcomes. Student evaluation is probably the mostR 

commonly used method of attempting to instigate change 
in faculty teaching performance. Two other sources of 
evaluation, by the instructor himself and by his peers, 
are used more sparingly, though most faculty acknowledge 
the value of both and in many instances prefer such 
; (24 evaluation to student evaluation. A brief discussion 
concordia * 4 of each of these modes of evaluation follows. 
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STUDENT EVALUATION - While the primary reward structures 
of many colleges and universities are directed to in- 
struction, research-based criteria for promotion, 

salary increases, and tenure are popular, precisely be- 
cause they are fairly easily objectified and even quan- 
tified. Such criteria are rarely found in assessments 
of teaching, except in the case of published textbooks 
and various kinds of teaching aids. 
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Student evaluations allow for such criteria 
and hence give teaching a 'fighting chance' 
against research as a basis for evaluating 

faculty performance. 


Research is also given first priority in 
many institutions because it is a prized 
enterprise with tangible results. Teach- 
ing, on the other hand, does not allow 

for comparisons. Precisely because 

most classrooms are autonomous and be- 
cause most professors grade either on 

the basis of a curve or on some subjective 
standard, one is unable to compare the 
production of two or more teachers. If 
effectively conducted, student evaluations 
produce data that allow for valid compar- 
isons between teaching performances, 

even if the differences in quality of pro- 
duction are not directly measured or 
compared. In other words, the student 
evaluation can help increase the teacher's 
"accountability' in the classroom thereby 
increasing the balance that might be 
assigned to documented effective teaching. 


Student evaluations may also provide a 

new medium for student - faculty interac- 
tion -thus hopefully assisting the faculty 
member in the development of instructional 
skills. The student becomes an active par- 
ticipant in decisions concerning classroom 
instruction and serves in a 'helping' role 
by providing the instructor with performance 
feedback. The instructor, in turn, assumes 
a temporary 'recipient' role. He is being 
provided with new information, emanating 
from a consumer population, concerning his 
own capabilities and style. The instructor 
then, becames accountable to the students 
who, in turn, become responsible for pro- 
viding the instructor with valid and use- 
ful information about his classroom per- 
formance. 


Accountability is also enhanced by stu- 
dent evaluation. Frequently, when teaching 
is used as a primary basis for performance 
evaluation, either because research is 
deemphasized (as in many private and cam- 
munity colleges) or because the faculty 
member has been trained specifically for 
teaching purposes (often in nonresearch- 
based humanities disciplines), the pri- 
mary criteria for this evaluation may too 
often become hearsay, orthodoxy, or politics. 


In each instance, the faculty member's per- 
formance in the classroom is not being directly 
or justly assessed. The student evaluation 
provides fair, though limited, input concerning 
instructional perfomnance in the classroom and 
hence can be useful in both faculty evaluation 
and development. 


The negative aspects of student evaluation 
should not be ignored. First, a negative eval- 
vation may result in defusive behavior, which 
can only block the process of change. One of 
the paradoxes inherent in change is that both 
people and institutions are least likely to 
change when someone tells them that they should 
Change. Thus, when presented with negative 
evaluations, many instructors are inclined to 
rationalize away the information [('The students 
don't know what is good for them," 'The instru- 
ment isn't valid.' 'That isn't really an im 
portant dimension of teaching anyway') or simpl 
to ignore it, particularly if the information 
is at odds with their sense of their own teach- 
ing ability. One way of possibly avoiding a 
defensive response on the part of the faculty 
member is to develop the kind of multilevel 
evaluative instrument discussed below, which 
would provide general and summary information 
for use by administrators and department 
Chaimmen but would reserve specific diagnostic 
and evaluative data for the use of the 

faculty member alone. Such an evaluation would 
provide both administratively useful and 
diagnostically helpful information. 


A second limitation of student evaluation is 
that the usefulness of the information generate 
by most instruments is often questionable. A 
typical course evaluation instrument will in- 
clude items such as 'the teacher establishes a 
wamm rapport with the students' or 'the teacher 
presents a clear, coherent lecture.' What 

can a teacher learn fram low ratings on either 
of these items? Neither item provides the 
type of discrete, concrete information that 
leads to change. Furthermore, most items of 
this sort are highly correlated with general 
evaluative items (ratings of overall course 
quality) and hence may not be in fact measurinc 
anything other than how much the student liked 
the course content and/or course instructor. 


Third , student evaluations are also a disservic 
to the development of faculty when, as is ofter 
the case, they are used as the only means of 
feedback to the instructor. 
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While student evaluations are important 
they provide only one type of informa- 
tion while ignoring the usefulness of 
self and peer evaluations, classroom 
diagnosis, behavioral outcomes, and 
‘postcourse folowup. Student evalua- 
tions are very seductive: they are 
inexpensive, they involve student time 
(expendable). rather than faculty time 
(valuable), they are easily quantified 
and computerized. Consequently, many 
administrators and some faculty may 
assume they are an adequate and suf- 
ficient means of evaluation. No 
information may be better than partial 
information, but when such crucial 
decisions as those of promotion, salary, 
and tenure depend on such information, 
it would seem the development of re- 
liable and helpful student evaluations 
is essential. 


Several steps can be taken to improve 
the quality of student evaluation pro- 
cedures: a) the instrument can be re- 
duced to a minimal number of items by 
means of factor analyses and related 
statistical techniques, b) the instru- 
ment can be designed to be minimally 
evaluative and maximally descriptive, 
using checklists and precise situational 
descriptors (‘under condition X, the 
teacher is likely to do a,b,c, or d') 

c) the instrument can be designed so 
that same items are primarily designed 
for tenure, salary, and promotion de- 
cisions, while other items are primarily 
designed for instructional improvement. 


SELF-EVALUATION - The faculty member 
himself is, of course, the most critical 
factor in any effective program designed 
to improve instruction. An attempt at 
instructional improvement on the part 
of the faculty member will take place 
only if he evaluates his own performance 
as inadequate or below his own personal 
standards. 


Another way to conceptualize this aspect 
of change can be borrowed from Kurt Lewin 
who describes the 'unfreezing' phase of 
change. 


An individual must have experienced some 
Giscrepancy, dissonance, pain, or stress 
before he will commit himself to the dif- 
ficult task of change. TIewvin believes 
that this unfreezing must precede any sig- 
nificant learning experience if change is 
to occur. Without this unfreezing an in- 
Gividual will either proceed 'pro forma' 
through the change program without really 
being affected by it or will resist the 
program before it is even begun. 


An effective faculty development program 
should contain a phase in which faculty 

are asked to assess their own strenghts, 
weaknesses, and areas for improvement. 

One procedure that can be followed is to 
have the faculty member fill out the same 
evaluation instrument that is being com- 
pleted by his peers or students. Discrepan- 
cies can thus be noted between not only 

the faculty member's own actual and ideal 
ratings, but also between them and the 
ratings of others. This 'consensual vali- 
dation' procedure is essential to personal 
growth as well as to instructional developmen 


PEER EVALUATION - This form of evaluation 

is rarely found in faculty development 
programs, though several instances of peer 
evaluation are cited by Eble. The evalua- 
tors in these cases were not actually 'peers' 
in the strict sense of the word, since they 
were either senior and usually tenured 
faculty observing untenured faculty or were 
untenured faculty observing graduate 
teaching assistants. The reluctance of 
many academic institutions and departments 
to develop a peer evaluation program is 
quite understandable given the shortage of 
time and the low level of trust found in 
many academic organizations. These factors 
must be faced and managed if peer evaluation 
is to succeed. 


One effective way of reducing the time 
factor is to encourage team teaching. By 
attending another team member's class, one 
can provide informal peer observation and 
evaluation while participating in a course 
for which one is partially responsible and 
compensated. Alternatively, if a depart- 
ment regularly rotates class assignments, 
then it will benefit a faculty member 
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to sit in on a colleague's course, knowing 
he will eventually be teaching it. Desig- 
nating one member of the department as a 
master teacher is another means of encoura- 
ging peer evaluation. This person would be 
chosen on the basis of such widely accep- 
ted criteria of success as course enroll- 
ment, student performance on standardized 
tests, reputation, or teaching experience. 
This master teacher could, in turn, be 
assigned a reduced teaching lozd, so that 
he or she might attend colleagues' classes. 
This assignment should probably be rotated 
among several faculty on a yearly basis. 


GENERAL CONCLUSIONS - First, self, peer, 
and student evaluation can be useful as- 
pects of faculty development. In issolation 
however, each of these approaches is poten- 
tially more destructive than not and con- 
sequently should be integrated into a com- 
prehensive, multistrategy approach to fa- 
culty development. Secondly, change is a 
subtle and complex process. It is not en- 
couraged by the use of an insensitive, of- 
ten arbitrary, reliance on evaluative ra- 
tings of performance. Preparation for change 
('unfreezing') in instructional perfor- 
ance Occurs when the teacher is confronted 
with information that is discrepant with 
his self-image but which does not deflate 


his self-esteem. 


* Adapted from "Components of an Effective 
Faculty Development Program" by William 
H. Bergquist and Steven R. Philips. 


AND NOW FOR SOMETHING COMPLETELY DIFFERENT 


Dear Mom and Dad: 


It has now been three- months since I left 
for college. I have been remiss in writing 
and I am very sorry for my thoughtlessness 
in not having written before. I will bring 
you up to date now, but before you read on, 
please sit down. You are not to read any 
further unless you are sitting down, okay? 


Well, I am getting along pretty well now. 
The skull fracture and the concussion I got 
when I jumped out of the window of my 
Gommitory when it caught fire shortly after 
my arrival, is pretty well healed now. I 
only spent two weeks in the hospital and 
now I can see almost normally and only get 


those sick headaches once a day. 


Fortunately, the fire in the dormitory and 

my jump was witnessed by an attendant at the gz 
station near the dorm and he was the one who 
called the fire department and the ambulance. 
He also visited me in the hospital and since 

I have nowwhere to live because of the bummed 
out domnitory, he was kind enough to invite 

me to share his apartment with him. 


It's really a basement room, but it's kind of 
cute. He is a very fine boy and we have 
fallen deeply in love and we are planning to 
get married. We haven't set the exact date 
yet, but it will be before my pregnancy begins 
to show. I know how much you are looking for- 
ward to being grandparents and I know you will 
welcome the baby and give it the same love 
and devotion and tender care you gave me when 
I was a child. 


The reason for the delay in our marriage is 
that my boy friend has a minor infection 

Which prevents us from passing our premarital 
blood tests and I carelessly caught it from hir 
This will clear up with penicillin injections 
I am taking daily. I know that you will wel- 
come him into our family with open arms. He is 
kind and although not well educated, he is 
ambitious. Although he is of a different race 
and religion than ours, I know your oft 
expressed tolerence will not permit you to be 
bothered by this “act. 


Now that I have brought you up to date I 

want to tell you that there was no dormitory 
fire, I did not have a concussion or a skull 
fracture, I was not in the hospital, I am not 
engaged, do not have a disease and there is no 
miscegnenation in my life. However, I am 
getting a 'D' in History and an 'F' in Science 
and I wanted you to see those grades in the 
proper perspective. 


Hope you are both well and will get home to 
see you soon. : 


Your loving daughter, 


Sue. 


